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METHOD AND SYSTEM FOR DIRECTING REQUESTS FOR CONTENT TO A 
CONTENT SERVER BASED ON NETWORK PERFORMANCE 



BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

This invention pertains generally to network communications, and more 
particularly to redirecting requests for content to a particular content server in a 
group of content servers based on a cost function indicative of operational 
characteristics of the network, such as network performance. 

10 2. Description of the Background Art 

One of the most common compfaints of Internet users is that it simply takes 
too much time to access information. This is a particular concern for online 
vendors conducting e-commerce transactions. Many customers or potential 
customers may not return to a site if access Is too slow, their browser locks up in 

15 the middle of a transaction, transactions are duplicated because they resubmit 
information as a result of believing that their browser has locked up during a 
transaction, or they are otherwise dissatisfied with the overall speed of accessing 
the site. While some of the problems experienced can be caused by the site 
itself, many of the problems experienced today are due to network performance. 

20 One of the causes of unacceptable network performance is due to the fact 

that the Internet is a network of interconnected networks. As a result, more than 
one path may exist between the location at which the data originates and the 
destination to which the data will be delivered. Typically data is transmitted in 
"packets" which include a destination address. However, there is no guarantee 

25 that the route assigned to the data to reach that destination address will be the 
most efficient at all times due to the dynamic nature of network capability. For 
example, a path that is free at one point in time may become congested at 
another point in time. Or, a portion of the network may become unavailable, thus 
causing the packets to be re-routed after leaving the point of origin. Further, a 

30 network carrier who provides a portion of the intermediate path send the packets 
to another network carrier through a network access point if the destination is not 
a customer of that carrier, thereby resulting in data loss or additional re-routing. 
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As can be seen, therefore, the packets nnust hop from network to network to reach 
their destination. The result is that each hop can contribute to additional delivery 
delay, or even cause a loss of data. The delivery delay that may be experienced 
can have a detrimental effect on the data transmission, and can be analogized to 
5 the decibel (db) loss experienced when signals are transmitted through a lossy 
medium. 

Rather than pursue routing solutions, a number of companies are pursuing 
"content delivery" techniques in an attempt to enhance performance on the 
Internet. These content delivery techniques include caching, intelligent routing, 

10 and content optimizing, as described beiow. 

For example, when an internet browser sends a request for a Web page, it 
first receives a hypertext markup language (HTML) file from the site that describes 
the Web page. The browser then sends one or more requests for the embedded 
files displayed on the Web page, such as images, audio clips, or video; that is the 

15 content. As can be seen, this process requires two or more requests for 
information to be made from the user to the Web page, thus having a direct 
impact on delivery time. To reduce the delivery time, some "content providers" 
cache the site's content on multiple servers at different geographical (physical) 
locations. Then, when a browser sends a request for a Web page, the HTML file 

20 that is sent back is accompanied by an internet protocol (IP) address that directs 
the browser to the geographically or topologicaliy closest server that caches the 
content. The theory behind this approach is that the path to the server that is 
geographically or topologicaliy closest to the user will be the fastest path. 

A refinement of the foregoing approach has been to optimize content and 

25 route the content based on demand. For example, the content of a Web page 
can be separated into "objects" representing images, video, text, and audio which 
are then ranked by user demand. Based on this ranking, the objects are cached 
at servers that are geographically closest to the users demanding access to the 
objects. To do so, a real-time map of Internet traffic is maintained for determining 

30 to which servers to send the objects for caching based on demand. 

While the foregoing techniques are designed to speed delivery of content 
to users, they all suffer from a common drawback; namely, that the path to the 
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geographically closest location to the user may not be the optimum path. To the 
contrary, a path to an entirely different server that may not be the geographically 
or topologically closest may provide for a faster response time. Furthermore, such 
techniques do not direct a user to a particular content server based on a cost 
5 function in a closed loop system. Therefore, a need exists for a method and 
system for providing a user with the IP address of a content server based on 
criteria other than geography or topology alone. The present invention satisfies 
that need, as well as others, and overcomes the deficiencies in current 
techniques. 

10 BRIEF SUMMARY OF THE INVENTION 

The present invention generally comprises a method and system for 
pointing a user requesting access to content on a particular content server to one 
of a plurality of content servers that may provide that content. More particularly, 
the content server to which the user is directed is selected based on one or more 

15 criteria that satisfy a cost function indicative of operational characteristics of the 
network.. The invention operates in a closed loop where additional cost 
measurements are made each time a user is directed to a content server and that 
infonnation becomes pari: of the data store for evaluating which content server 
should be selected for serving subsequent requests for content. 

20 For example, the user may be directed to a part:icu!ar content server if the 

user can access that server more quickly than another content server. While that 
content server may also be closest to the user in physical space, the two locations 
do not necessarily have to coincide. Another example would be to direct the user 
to a content server based on one or more criteria that are indicative of best 

25 performance for that user. Another example would be to use reliability, such as 
least packet loss, to the content server as a performance criteria. Another 
example would be to direct the user to a particular content server based on 
economic or financial cost criteria. Still another example would be to use the 
geographical location of the content server as a performance criteria. 

30 In other words, the invention directs a user to a content server based on a 

cost function that takes into account one or more cost criteria indicative of 
operational characteristics of the network.. In this regard, note that the routing to 
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a particular location is not being changed; routing is handled in a different manner 
through techniques described in, for example, U.S. Patent No. 6,009,081 which is 
incorporated herein by reference. In the present invention, the user is being 
directed to an IP address of a particular content server. 
5 By way of example, and not of limitation, the IP address of the client who is 

requesting the content and the ID of the customer whose content is being 
requested are determined. The customer's ID is mapped to one or more content 
servers where the customer's content is located. Then the client's IP address is 
mapped to one of those content servers based on performance data to ensure 

10 that the best performance is achieved. It is important to note that, while the best 
performance to a content server for a particular user is one measure of cost, it is 
not the only measure of cost that can be used to direct the user. Nor is best 
performance necessarily synonymous with the geographically or topologically 
closest content sen/er. Instead, the content server is selected based on one or 

15 more criteria that may include an estimate of the best performance, such as 
fastest response, and which may or may not translate to the geographically or 
topologically closest content server. Based on one or more cost factors such as 
performance measurements, the client's IP address, the customer's ID, and the 
locations of the content servers, the present invention returns the IP address of 

20 the content server satisfying the cost function for that client. According to an 
optional aspect of the invention, all clients using the same DNS server would be 
treated as satisfying the same criteria for ease of implementation. 

Further objects and advantages of the invention will be brought out in the 
following portions of the specification, wherein the detailed description is for the 

25 purpose of fully disclosing preferred embodiments of the invention without placing 
limitations thereon. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The invention will be more fully understood by reference to the following 
drawings which are for illustrative purposes only: 
30 FIG. 1 is a system and data flow diagram showing configuration and 

operation of an embodiment of the present invention. 

FIG. 2 is a diagram depicting a geographical inference method according to 
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the present invention. 

FIG. 3 is a diagrann depicting a circular intersection locating technique 
according to the present invention. 

FIG. 4A through FIG. 4F are diagrams depicting an alternative embodiment 
5 of the circular intersection technique shown in FIG. 3 which uses linear 
approximations. 

FIG. 5 is a diagram depicting an intelligent inference technique according 
to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

10 Referring first to FIG. 1 , a schematic diagram of a network configuration 10 

according to the invention is shown in the context of the Internet. FIG. 1 also 
depicts the preferred flow of information through the Internet according to the 
present invention, it will be appreciated, however, that the present invention is 
applicable to any interconnected network in which there are at least two servers 

15 within the network that contain the same content for a site that is being requested 
by a client. In the example that will be described, two content servers and three 
private network access points (PNAP) are shown. However, the invention can be 
applied to any number of content servers and PNAPs. It will further be 
appreciated that the invention is not limited to use in connection with PNAPs; to 

20 the contrary, the invention is applicable to any network or networks to which at 
least two content servers are connected. The invention is described in the context 
of PNAPs as part of the preferred system in which the invention can be 
implemented. 

The premise of the present invention is that a client 12 desires to access 
25 content associated with a customer's Web site 14. By "client" we mean a 
computer that accesses a network such as the Internet through a connection, 
such as a PNAP. By "customer*' we mean a network server, such as a Web site 
server, with which there is associated two or more content servers that may 
provide the desired content. In addition, by "content server" we mean a server 
30 with a unique internet protocol (IP) address, a group of servers with a common IP 
address, multiple data servers or the like, wherein the server(s) can be configured 
such that selection can be made from among two or more server addresses. 
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In the example described herein, which represents an embodiment of the 
system configuration in which the invention would be used, it is assumed that 
there is at least one PNAP, and preferably two PNAPs, connected to the Internet. 
It is also assumed that addressing is IP, that we are using HTTP and DNS, and 
5 that the customer will have two or more content servers connected to the same or 
different PNAPs. For example, one content server could be connected to a first 
PNAP, a second content server could be connected to a second PNAP, a third 
content server could be connected to a third PNAP, and so on. For purposes of 
this example, also assume that the IP address of client 12 is 10.0.0.1, that the 

10 uniform resource locator (URL) of Web site 14 Is www.superperformance.com , 
that the IP address of the customer is 197.172.20.14, that the customer's identity 
(ID) is "superperformance", and that the client desires to access the home page 
www.superperformance.com which is "index.html". Again, however, the invention 
is applicable to any network configuration with multiple content servers, as well as 

15 to any IP service or addressing protocol. 

In the example shown, client 12 will enter www.superperformance.com as 
the URL in their browser. At step 1 00, the client's browser sends a request for 
www.superperformance,com who, as stated before, is assumed to be a customer 
with content than can be accessed on two or more content servers located within 

20 one or more PNAPs, The request is received by a domain name system (DNS) 
server 16 that is maintained either by the client or by the client's internet service 
provider (ISP). At step 102, DNS server 16 returns 197,172.20.14 as the IP 
address for superperformance.com. At step 104, the client's browser sends a full 
page request to 197.172.20.14 which connects with the customer's Web site 14. 

25 At step 106, Web site 14 returns the full html page, which describes the 

embedded content as well as a URL that includes a redirector host name. The 
redirector host name is a new protocol that is unique to the present invention, and 
which contains certain information that is used for determining which content 
server the client should access. In this example, the redirector host name would 

30 have the following basic format: client-ip.customer-id.lookup.pnap.net where client 
IP would correspond to 10.0.0.1, customer-id (e.g., customer identity) would 
correspond to ''superperformance", and lookup.pnap.net would correspond to the 
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address of a redirector DNS bridge (which is also a DNS server) which will be 
described below. Web site 14, which will know the client's IP address, will 
generate the redirector host name as part of the present invention. 

The more complete form of the URL for the content in this example would 
5 be http://1 0-0-0-1 .superperformance,lookuD.Dnap,net/index,html . It will be 
appreciated that other formats conveying the desired information could be used 
as well without departing from the present invention. For convenience, however, 
we have chosen to build a new layer on the existing DNS protocol. In other 
words, we have developed a new use of DNS. Instead of conventional IP to 

10 name mapping, we are creating an imaginary host name in a format that allows us 
to use DNS as the transport mechanism. The host name conveys additional 
information that is used for accessing the redirector DNS bridge and obtaining the 
IP address of the content server which provides best performance to the user. 

With this in mind, at step 108 the client's browser then sends the redirector 

15 host name to DNS server 16 which will not recognize the redirector host name. 
DNS server 16 will know, however, to make a recursive query to redirector DNS 
bridge 18 at step 110 because "lookup.pnap.net" will be contacted as a matter of 
the normal DNS lookup mechanism. 

At step 112 redirector DNS bridge 18 will send the client's IP address 

20 10.0.0.1 and the customer ID "superperformance" to redirector 20. At step 1 14, 
using information in a dynamic database 22 or an alternative data store (including 
DNS bridge 18 itself), redirector 20 returns the IP address for the content server 
based on the client's IP address, the customer's ID, and cost infomiation 
associated with accessing content servers containing the requested content. In 

25 the example shown, there are two content servers 24, 26 which replicate the 

requested content At step 116, redirector DNS bridge 18 sends the IP address of 
content server 22 to DNS server 16. At step 118, DNS server 16 sends the IP 
address of content server 24 to client 12. At step 120, the client's browser then 
contacts content server 24 with the request to serve up the embedded content, 

30 and the requested content is sent to client 12 at step 122. 

Note also that FIG. 1 shows two "spanners" 28, 30 associated with content 
servers 24, 26 respectively. Spanners 28, 30, which in this example are part of 
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PNAPs 34, 36, respectively, monitor and collect the cost associated with the 
client's request to the content server (e.g., latency, performance, etc.) The cost 
data is used to determine which content server will be selected by red i rector 20 in 
response to subsequent requests for content. In the example thus described, this 
5 would take place after the client's browser contacts content server 24 and before 
content server 24 serves up the requested content. The performance 
measurements can be stored in database 22 or alternative data store or even 
DNS bridge 18. As stated before, performance is one measure of cost which can 
be used to determine the content server to which the client will be directed. Other 

10 criteria can be used as well. 

As can be seen, therefore, there are essentially three components to the 
process. One is the determination of the IP address of the client who is 
requesting the content and the ID of the customer whose content is being 
requested. The second is mapping the customer's ID to one or more content 

15 servers where the customer's content can be accessed. The third is mapping the 
client's IP address to a particular content server based on one or more criteria 
indicative of operational characteristics of the network, such as network 
performance. It is important to note that network performance is not necessarily 
synonymous with the fastest path, and that the fastest path is not necessarily 

20 synonymous with the geographically or topographically closest content server. 
Instead, the content server is selected based on an evaluation of cost, which may 
or may not translate to the fastest path, shortest response time, least packet loss, 
lowest economic cost of service, or the geographically or topographically closest 
content server for that client The foregoing list is not all inclusive, but is provided 

25 by way of example of various measures of cost. Based on one or more measures 
of cost, the client's IP address, the customer's ID, and the IP addresses of the 
content servers, the redirector method of the present invention returns the IP 
address of the content server satisfying the cost function for that client. 

As an alternative to using the form of the redirector host name described 

30 above, a simplified form could be used. Referring to the previously example, the 
simplified form would be"superformance. lookup. pnap.net". Note that the client's 
IP address has been dropped. In this embodiment of the invention, redirector 20 
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would base its decision on the IP address of DNS server 16 instead the clienfs IP 
address. In this way, all clients who are using the same DNS server would be 
directed to the sanne content server for "superperfornnance.com". 

It will be appreciated, therefore, that the cost measurements should be 
5 continuously updated. It will also be appreciated that these measurements may 
contain infonnation concerning, for example, latency and reliability between a 
client and the content servers. In the exemplary embodiment of the invention 
described herein, latency measurements are obtained by employing spanners 28, 
30 for populating and updating a data store such as database 22. A "spanner" as 

10 used herein is a soflware process which measures and records, for example, 

costs such as latency between a client and a destination in the network. Note that 
the preferred location of a spanner is in proximity to a content server so that the 
spanner can monitor the performance of the client's access to the content server. 
If a spafiner were located elsewhere, then it would not be able to determine the 

15 cost characteristics of the request and transfer of content. 

Referring to FIG. 1, assume for example that client 12 is connected to a 
first PNAP 32, and that content servers 24, 26 are connected to second 34 and 
third 36 PNAPs, respectively. In order to determine the cost associated with 
accessing a content server, data is collected between client 12 and the PNAPs 

20 34, 36. For example, using the TCP/IP protocol, this is preferably done passively 
by watching the client's communications with destinations in a PNAP and 
measuring the time between the "syn ack" and the "ack" messages. The relative 
measurements between PNAPs can then be used to determine which content 
server can be accessed by the client with the least amount of network latency. It 

25 will be appreciated, however, that other handshakes may be employed if a 

protocol other than TCP/IP is used or developed. It will also be appreciated that 
there may be other suitable methods for making such measurements, including 
active methods such as pinging, that can be used as well, and that the invention is 
not limited to the foregoing passive method which is given by way of example as 

30 the preferred method. 

Note also that cost measurements between a!f clients and all network 
locations (e.g., PNAPs) containing content servers may not be available. For 
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ease of implementation, one solution would be to obtain one or more cost 
measurements for a client using a particular DNS server and then treat all clients 
using that same DNS server as if the costs were equivalent. Still another 
approach would be to obtain one or more cost measurements and then correlate 

5 those measurements with other clients who may be similarly situated (e.g., 
geographically). Still another approach would be to use initial randomization 
associated with directing a client to a particular content server. For example, 
initially we may direct the client to PNAP 34 and content server 24. At that points 
in time, a cost measurement such as latency can be made. The next time that the 

10 client requests content we may force the client to go to PNAP 36 and content 
server 26 where a measurement has not yet been made. In this regard, it will be 
appreciated that complete information can be obtained by iterating the 
measurements over all possibilities. It will also be appreciated that other 
approaches to making cost measurements may be suitable as well. 

15 It should be apparent that randomization may be useful for normal system 

operation as well as initial operation of the system. As can be seen, we 
essentially need up-to-date cost measurements from each cluster or set of IP 
addresses (rather than each IP address) to each content server (i.e., to PNAP in 
which a content server is located). Therefore, even though we may have a 

20 measurement for PNAP 24, we may send the client to PNAP 36 instead to get a 
measurement. The amount of time a client is sent to a different PNAP would be 
arbitrarily set, such as ten percent of the time. Further, suppose that several 
prefixes want to access "superperformance.com" and that one thousand 
customers in a prefix want to contact the site. The randomization could be 

25 applied to clusters or sets of IP addresses, such as prefixes. This allows us to 
strike a balance between exploration (e.g., making cost measurements) and 
exploitation of infomnation (e.g., designating a content server). Otherwise, If the 
client is always directed to what was previously determined to be the least cost 
(e.g., best performing) content server for that client, we would never obtain 

30 measurements for other content servers for that client This "overexploitation" of 
measurements could lead to less than desirable performance since a different 
content server may satisfy the cost function for that client On the other hand, if 
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we are always exploring (making measurements), we will never exploit the 
measurements. 

Accordingly, every time a client accesses a content server, the client 
provides performance data about that content server that can be observed by a 

5 spanner to measure and record performance, as well as provides data which can 
be used as an estimate of performance for the cluster or set of IP addresses 
containing the client's IP address. Therefore, it is possible to ieam how long it 
takes for the client (and the group of addresses) to access the destination. When 
the invention directs the client to the content server that gives best performance, 

10 the system also obtains information about the client. It will be appreciated that, by 
sending the client to a different content server part of the time, the system adapts 
over time. 

While the preferred approach to obtaining and maintaining the cost 
measurement data has been described, it may not be practical to monitor the 

15 performance or other criteria from every client's IP address or every set of 
addresses (e.g., such as prefixes) to a PNAP due to the large number of 
measurements that are required. For example, there are approximately seventy 
thousand prefixes in use; therefore, the number of measurements that would be 
required would be seventy thousand times the number of PNAPs. If prefixes are 

20 close together geographically, however, an inference can be made that physically 
proximate prefixes will experience similar network performance. In other words, a 
predictive characteristic can be added to the operation of the redirector in order to 
reduce the number of measurements that are required. A particularly suitable 
technique is to employ circular intersection to identify the geographical location of 

25 clients and then group IP addresses based on correlation of locations. 

For example, referring to FIG. 2, suppose that there are multiple clients 
with sets of IP addresses (e.g., prefixes) P1, P2 and P3 connected to a PNAP 
200. Using circular intersection techniques according to the present invention, we 
can determine the physical location of a set of IP addresses. In the preferred 

30 embodiment of the invention, this can be accomplished by first obtaining latency 
measurements between a client and PNAP 200 whose latitude and longitude is 
known. The minimum latency measurement in the set generally represents the 
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most accurate measurement for purposes of circular intersection according to the 
invention. For example, if one-thousand latency measurements are obtained, ail 
of the measurements except for the minimum measurement would be 
disregarded. The minimum latency measurement can then be converted to a 
5 distance equivalent by multiplying the measurement by the speed of light and 
dividing by two in the case of a round trip measurement such as is obtaining by a 
ping. Note, however, that this computation may overshoot the actual distance to 
the client in most networks due to the use of optic fiber in the network and the fact 
that light actually travels at a lower speed in fiber. However, only an estimate 
10 needs to be made for purposes of circular intersection according to the present 
invention. 

In the case of FIG. 2, the minimum latency measurements from PNAP1 
200 to P1 and P2 are 53 ms and 66 ms, respectively, and the minimum latency 
measurements from PNAP 202 to P1 and P2 are 105 ms and 100 ms, ^ 

15 respectively. Using this information, circles can then be drawn where the PNAP 
location is the center of the circle and the distance equivalent of the latency is the 
radius of the circle. In this regard, it will be appreciated that shorter return times 
result in smaller (i.e., tighter) circles, thus providing more precise measurements. 
It will also be appreciated that any test that measures the time that it takes for a 

20 signal or data to move to a location and back can be employed without departing 
from the invention, and that one way of making such a measurement is by 
sending a TCP/IP "ping" to the client from the PNAP. 

Referring also to FIG. 3, by taking similar measurements from multiple 
PNAPs 200, 202, 204, several circles such as circles 300, 302, 304 can be drawn 

25 and the intersection of the circles will correspond to the approximate physical 

location of the sets of IP addresses (e.g., a prefix), although the exact location will 
not be known for a number of reasons, including the fact that light travels at a 
slower speed through fiber. In this example, the intersection of the circles is the 
approximate location of P1 . An inference can then be made for sets of IP 

30 addresses that are physically close, but for which no actual measurements have 
been made; namely, that clients will experience similar network conditions. 
Therefore, in the example of FIG. 2, assume that measurements were taken for 
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P1 and P2, but not for P3. If P3 is physically close to P1 and P2, a circie of 
inference 206 can be drawn for P3. This assumes, however, that set P3 was 
located one point in time so we know that set P3 is in the circle of inference for 
sets P1 and P2. 

5 It should be apparent from the foregoing discussion that the sets of IP 

addresses can vary in size and, in addition, that once a circle of inference is 
drawn around sets of IP addresses, those sets can be used for drawing new 
circles of inference. For example, suppose that P1 , P2 and P3 are sets of one. 
Once the circle of inference 206 is drawn around those sets, their combination 

10 can form a new set P4 (not shown). Now, assume that P5 (not shown) falls within 
the circle of inference for set P4. A new inferred set can then be created, which is 
the combination of P4 (P1, P2 and P3) and P5. Therefore, we can create new 
sets and sets of sets using this method. 

Note that it is possible to implement circular intersection more efficiently by 

15 employing an approximation technique. Determining the intersection of a set of 
circles as the number of circles increases using conventional computational 
techniques can. become computationally complex since the relationship between 
time that it takes to compute the intersections and the Increased number of 
intersections is not linear. A linear approximation, on the other hand, is the fastest 

20 way to implement circular intersection even though it is not as accurate. This can 
be accomplished, for example, by summarizing the previous intersections with an 
intersection object. The intersection object is then intersected with a subsequent 
circle or another object representing that circle. Each time that an intersection is 
determined, the intersection is summarized with a new intersection object that is 

25 used for purposes of subsequent intersections. 

For example, suppose that we have three circles 300, 302 and 304 as 
described before. A linear approximation of the intersection can be determined as 
follows. First, the intersection 306 of two of the circles, such as circles 300, 302 
would be determined as shown in FIG. 4A. Next, the area of intersection can be 

30 circumscribed by an intersection object 308, which is preferably rectangular in 
shape as shown in FIG. 4B. The intersection object 308 should represent the 
smallest bounding box that encloses the intersection. Referring also to FIG. 4C, 
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the estimated intersection is the cross-hatched 310 area inside intersection object 
308. Now, when the third circle 304 is drawn, the intersection of circle 304 and 
intersection object 308 can be determined. In the example shown In FIG. 4D, the 
intersection of circle 304 and intersection object 308 is shown as the cross- 
5 hatched area 312. However, since the intersection still involves taking curvature 
into account, computational efficiency can still be optimized. This can be 
accomplished by replacing circle 304 with a rectangular-shaped object 
representing circle 304, such as square 314 shown in FIG. 4E which 
circumscribes circle 304. The intersection is shown as the cross-hatched area 

10 316 bounded by a new rectangular-shaped intersection object 318. 

Intersection object 318 would then be used for the next intersection with a 
circle by again replacing the circle with a rectangular-shaped object representing 
that circle. As can be seen, therefore, each intersection creates a new 
intersection object that can be used for a subsequent intersection. 

15 In order to reduce computational complexity, note in FIG. 4E that square 

314 has been aligned with intersection object 308 such that corresponding sides 
are parallel. This ensures that intersection object 318 is rectangular-shaped. To 
further reduce computational complexity, it is also possible to rotate the 
coordinate system of the intersecting circles so that the longitudinal axis through 

20 intersection object 308 is oriented vertically and aligned with the vertical axis in a 
normal Cartesian coordinate system as shown in FIG. 4F. Additional refinements 
include, but are not limited to: 

(1 ) if one circle contains another circle, discarding the larger circle to 
provide a tighter intersection; 

25 (2) if more than two circles in a set are to be intersected and the circles 

are similar in size, starting with the two circles that are the farthest apart; 

(3) if more than two circles in a set are to be intersected and the circles 
are different in size, starting with the two circles having the smallest radii to 
provide the tightest intersection. 

30 Therefore, the above-described method summarizes previous intersections 

with an intersection object. The intersection object is then intersected with a 
subsequent circle or an object representing the subsequent circle. While the 
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intersection objects are preferably rectangular-shaped as described above, they 
couid alternatively have other shapes that are also polygons. The method 
reduces computational complexity and increases computational speed by 
employing a linear computation technique, at the expense of accuracy, rather than 
5 employing a technique that is not linear. In other words, if n represents the 
number of circles being intersected, the computational complexity for exact 
intersection is 0(n®) whereas it is 0(n) in the approximation method described 
above. 

Accordingly, it can be seen that a spanner measures performance 
10 characteristics while circular intersection estimates the physical location of a 

client Accordingly, circular Intersection is an operational tool that can be used to 
speed up populating the store of cost measurements when actual measurements 
are not available; it is not, however, an essential part of the invention. 

Referring now to FIG. 10, an "intelligent inference" method according to the 
15 invention will be described which is more accurate than drawing a circle of 
inference around physically proximate sets of IP address as was described 
previously in connection with FIG. 2. In FIG. 4, let Ca represent a first content 
server, let Cb represent a second content server, let S^, Sg, S3 and S4 represent 
sets of IP addresses, let L represent latency, and let D represent distance. We 
20 can use a spanner to obtain latency measurements from content server Ca to 
(L^a), S2 (Lga) and S3 (LsJ, and use circular intersection to determine the distances 
between S^ and S^ (D^J, S2 and 84 (D24), and S3 and S4 (D34). With this 
information, we can obtain a weighted average of latency measurements to infer 
the latency measurement from content server Ca to S4 as follows: 
25 r \ 

1 



1 1 

4-- 



V^A4 A4 ^34 7 



By taking the weighted average in this manner, we obtain an approximation of the 
30 latency from content server Ca to S4. Note also that inferences can be made in 
other ways, including, but not limited to, the following: 

1 . Monitoring sets of IP addresses and then treating all IP addresses in 
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the set in the same fashion. 

2. Aggregating prefix groups based on similarities and treating all such 
aggregated prefix groups in the same fashion. 

3. Disaggregating prefix groups into subgroups that have similar 
5 characteristics and treating the subgroups in the same fashion. 

4. Placing IP addresses into sets based on some criteria of similarity 
such as, but not (imited to, performance, geographical location, and other 
correlation factors, and treating all IP addresses in the sets in the same fashion. 

In other words, inferences are ideally made based on sets of IP addresses. 

10 A set can be a single IP address (e.g., a set of one), a group of IP address in a 
BGP4 prefix if the prefix is small, the union of two sets wherein the two sets are 
geographically close, the union to sets wherein the two sets experience similar 
performance in relation to content servers, and the like. 

Therefore, it will be appreciateci that efficient implementation of the present 

15 invention requires cost measurements about the network that can used to 
determine if directing a client to a particular content server will satisfy a cost 
function, and it will further be appreciated that the decision may be irrespective of 
the actual physical location of the client and the content server Initially, however, 
cost measurements may not be available for all clients and content servers. As 

20 are result, some amount of randomization or estimation may be necessary until 
the system is trained and the store of performance data is populated. In addition, 
knowledge of the physical location of the client and/or sets of IP addresses may 
be helpful for drawing an inference that proximate physical locations may 
experience similar network conditions. Such inferences can be used as an 

25 alternative to obtaining measurements from each client IP address to each PNAP 
or content server. Note, however, that some measurements, such as latency, 
need to be updated frequency due to changes in network conditions whereas 
geographical locations of clients are static. Therefore, inferences should be 
drawn close in time to when measurements of a dynamic nature are made. 

30 It will also be appreciated that the system of the present invention will 

automatically balance network load among PNAP's. Another load balancing 
option would be to provide the customer with a software interface that allows them 
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to report load on the content servers so that redirection can also be based on 
balancing server load. 

It will be appreciated that the method and system would preferably be 
implemented using a programmed data processor such as a computer and 
5 associated software to carry out the functions described herein. For example, 
DNS bridge 18, redirector 20, and spanners 28, 30 would be Implemented as 
software running on a programmed data processor such as a conventional 
computer. Those skilled in the art will appreciate that the actual code to 
implement the invention as described herein can be written for various platforms 

10 using conventional programming techniques. Accordingly, the details of the code 
are not presented herein. 

As can be seen, therefore, the invention provides for obtaining cost 
measurements of various types associated with serving a request for content to a 
user and ^directing the user to a particular content server based in satisfaction of a 

15 cost function indicative of operational characteristics of the network. The 

invention operates in a closed loop wherein an additional cost measurement is 
made each time a user is directed to a content server and that information 
becomes part of the data store for evaluating which content server should be 
selected for sen/ing subsequent requests for content from that content server. 

20 Although the description above contains many specificities, these should 

not be construed as limiting the scope of the invention but as merely providing 
(liustrations of some of the presently preferred embodiments of this invention. 
Thus the scope of this invention should be determined by the appended claims 
and their legal equivalents. Therefore, It will be appreciated that the scope of the 

25 present invention fully encompasses other embodiments which may become 
obvious to those skilled in the art, and that the scope of the present invention is 
accordingly to be limited by nothing other than the appended claims, in which 
reference to an element in the singular is not intended to mean '*one and only 
one" unless explicitly so stated, but rather "one or more." All structural, chemical, 

30 and functional equivalents to the elements of the above-described preferred 
embodiment that are known to those of ordinary skill in the art are expressly 
incorporated herein by reference and are intended to be encompassed by the 
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present claims. Moreover, it is not necessary for a device or method to address 
each and every problem sought to be solved by the present invention, for it to be 
encompassed by the present claims. Furthermore, no element, component, or 
method step in the present disclosure is intended to be dedicated to the public 
5 regardless of whether the element, component, or method step is explicitly recited 
in the claims. No claim element herein is to be construed under the provisions of 
35 U.S.C. 1 12, sixth paragraph, unless the element is expressly recited using the 
phrase "means for." 
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1 . A method for directing a network client requesting access to content 
5 to one of a plurality of content servers that can provide said content, comprising: 

directing a network client to a said one of said content servers based on 
one or more cost measurements indicative of operational characteristics of the 
network. 

10 2. A method as recited in claim 1, further comprising: 

obtaining a new cost measurement when said network client accesses said 
content server; and 

using said new cost measurement as an indicator of operational 
characteristics of the netwoiK in connection with subsequent requests for access 
15 to said content that can be provided by said content server. 

3. A method as recited in claim 1 , wherein said content servers are 
associated with a network server having an identity, and wherein said network 
client requests content from said network server, and further comprising: 

20 mapping the identity of the network server to said content servers. 

4. A method as recited in claim 1, further comprising measuring 
network performance between said network client and a said one of said content 
servers. 

25 

5. A method as recited in claim 1 , wherein an attribute of network 
performance comprises network latency. 

6. A method as recited in claim 5, wherein network latency is measured 
30 passively by determining the time between a syn ack message sent by said 

network client and an ack message sent by one of said content servers. 
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7. A method as recited in claim 4, further comprising measuring 
network performance between said network client and another of said content 
servers. 

5 

8. A method as recited in claim 1, further comprising determining the 
location of said network client by circular intersection and inferring network 
performance associated with accessing said content server to said network client 
based on a performance measurement to said content server in connection with 

10 another physically proximate network client 

9. A method as recited in claim 8, wherein said circular intersection 
comprises: 

(a) measuring the time that it takes for data to move from a plurality of 
network server locations to said client; 

(b) converting said times to distance equivalents; 

(c) forming a plurality of intersecting circles using said distance 
equivalents as the radius of circles with said network server locations as the 
center; and 

(d) determining the physical location of said network client from the 

intersection ^of said circles. 

10. A method as recited in claim 1, further comprising inferring network 
performance of serving said network client from said content server by 

25 determining a weighted average of network performance between said content 
server and other network clients based on physical proximity of said other network 
clients to said network client and performance of said content server for said other 
network clients. 

30 1 1 . A method as recited In claim 1 , further comprising: 

(a) measuring network latency between a content server and a plurality 

of other network clients; 
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(b) determining physical distances between said other network clients 
and said network client; 

(c) computing a weighted average of said latency measurements as a 
function of said distances, wherein said weighed average comprises an estimate 

5 of the latency between said content server and said network client; and 

(d) inferring operational characteristics associated with a plurality of 
network clients to said network client using said weighted average. 



10 12. A method for directing a network client requesting access to content 

from a network server to one of a plurality of content servers that can provide said 
content, each said content server having an address, said network server having 
an identity, said method comprising: 

(a) identifying a network server associated with content requested by 
15 said network client; 

(b) identifying a said one of said content servers based on said identity 
of said network server and one or more cost measurements indicative of 
operational characteristics of the network; and 

(c) providing the network client with the address of said content server 
20 identified in step (b). 

13. A method as recited in claim 12, further comprising: 

(d) obtaining a new cost measurement when said network client 
accesses said content server; and 

25 (e) using said new cost measurement as an indicator of operational 

characteristics of the network in connection with subsequent requests for access 
to said content that can be provided by said content server 

14. A method as recited in claim 12, further comprising measuring 

30 network performance between said network client and a said one of said content 
servers. 
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15. A method as recited in claim 12, wherein an attribute of network 
performance comprises network latency. 



16. A method as recited in claim 15, wherein network latency is 

5 measured passively by determining the time between a syn ack message sent by 
said network client and an ack message sent by said one of said content servers. 

17. A method as recited in claim 14, further comprising measuring 
network performance between said network client and another of said content 

10 servers. 

18. A method as recited in claim 12, determining the location of said 
network client by circular intersection and inferring network performance 
associated with accessing said content server to said network client based on a 

15 performance measurement to said content server in connection with another 
physically proximate network client. 

19. A method as recited in claim 18, wherein said circular intersection 
comprises: 

20 (a) measuring the time that it takes for data to move from a plurality of 

network server locations to said client; 

(b) converting said times to distance equivalents; 

(c) forming a plurality of intersecting circles using said distance 
equivalents as the radius of circles with said network server locations as the 

25 center; and 

(d) determining the physical location of said network client from the 
intersection of said circles, 

20. A method as recited in claim 12, further comprising inferring network 
30 performance of serving said network client from said content server by 

determining a weighted average of network performance between said content 
server and other network clients based on physical proximity of said other network 

22 



wo 01/90911 PCT/USOO/23879 

clients to said network client and performance of said content server for said other 
network clients. 

21. A method as recited in claim 12, further comprising: 
5 (a) measuring network latency between a content server and a plurality 

of other network clients; 

(b) determining physical distances between said other network clients 
and said network client; 

(c) computing a weighted average of said latency measurements as a 
10 function of said distances, wherein said weighed average comprises an estimate 

of the latency between said content server and said network client; and 

(d) inferring operational characteristics associated with a plurality of 
network clients to said network client using said weighted average. 



15 22. A method for directing a network client requesting access to content 

from a network server to one of a plurality of content servers providing said 
content for said network server, each said content server having an address, said 
network server having an identity, said method comprising returning the address 
of a content server that may provide said content the identity of the network server 

20 based on one or more cost measurements indicative of operational characteristics 
of the network, obtaining a new cost measurement when said network client 
accesses said content server, and using said new cost measurement as an 
indicator of operational characteristics of the network in connection with 
subsequent requests for access to said content that can be provided by said 

25 content server. 



23. A method as recited in claim 22, further comprising measuring 
network performance between said network client and a said one of said content 
server. 

24. A method as recited in claim 22, wherein an attribute of network 
performance comprises network latency. 
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25. A method as recited in claim 24, wherein network latency is 

5 measured passively by determining the time between a syn ack message sent by 
said network client and an ack message sent by said one of said content servers. 

26. A method as recited in claim 23, further comprising measuring 
network performance between said network client and another of said content 

10 servers. 

27. A method as recited in claim 22, further comprising determining the 
location of said network client by circular intersection and inferring network 
performance associated with accessing said content server to said network client 

15 based on a performance measurement to said content server in connection with 
another physically proximate network client. 

28. A method as recited in claim 27, wherein said circular Intersection 
comprises: 

20 (a) measuring the time that it takes for data to move from a plurality of 

network server locations to said client; 

(b) converting said times to distance equivalents; 

(c) forming a plurali^/ of intersecting circles using said distance 
equivalents as the radius of circles with said network server locations as the 

25 center; and 

(d) determining the physical location of said network client from the 
intersection of said circles. 

29. A method as recited in claim 22, further comprising inferring network 
30 performance of serving said network client from said content server by 

determining a weighted average of network performance between said convent 
server and other network clients based on physical proximity of said other network 
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clients to said network client and performance of said content server for said other 
network clients. 



30. A method as recited in claim 22, further comprising: 

(a) measuring network latency between a content server and a plurality 
of other network clients; 

(b) determining physical distances between said other network clients 
and said network client; 

(c) computing a weighted average of said latency measurements as a 
function of said distances, wherein said weighed average comprises an estimate 
of the latency between said content server and said network client; and 

(d) inferring operational characteristics associated with a plurality of 
network clients to said network client using said weighted average. 

31 . A method for determining the physical location of a network client 
comprising: 

(a) measuring the time that it takes for data to move from a plurality of 
network server locations to a network client; 

(b) converting said times to distance equivalents; 

(c) forming a plurality of intersecting circles using said distance 
equivalents as the radius of circles with said network server locations as the 
center; and 

(d) determining the physical location of said network client from the 
intersection of said circles, 

32. A method for inferring operational characteristics associated with a 
plurality of network clients to an inferable network client, comprising: 

(a) measuring network latency between a network server and a plurality 
of network clients; 

(b) determining physical distances between said network clients and an 
inferable network client; and 

(c) computing a weighted average of said latency measurements as a 
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function of said distances, wherein said weighed average comprises an estinnate 
of the latency between said network server and said inferable network client. 



33. A system for directing a network client requesting access to content 
5 to one of a plurality of content servers that can provide said content, comprising: 

a programmed data processor; and 

programming associated with said programmed data processor for 
directing a network client to a said one of said content serveiB based on 
one or more cost measurements indicative of operational characteristics of the 
10 network. 

34. A system as recited in claim 33, further comprising programming 
associated with said programmed data processor for: 

obtaining a new cost measurement when said network client 
15 accesses said content server; and 

using said new cost measurement as an indicator of operational 
characteristics of the network in connection with subsequent requests for 
access to said content that can be provided by said content server. 

20 35. A system as recited in claim 33, wherein said content servers are 

associated with a network server having an identity, and wherein said network 
client requests content from said network server, and further comprising: 

programming associated with said programmed data processor mapping 
the identity of the network server to said content servers. 

25 

36. A system as recited in claim 33, further comprising programming 
associated with said programmed data processor for measuring network 
performance between said network client and a said one of said content servers. 

30 37. A system as recited in claim 33, wherein an attribute of network 

performance comprises network latency. 
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38. A system as recited in claim 37, wherein network latency is 
measured passively by determining the time between a syn ack message sent by 
said network client and an ack message sent by one of said content servers. 

5 39. A system as recited in claim 36, further comprising programming 

associated with said programmed data processor for measuring network 
performance between said network client and another of said content servers. 

40. A system as recited in claim 33, further comprising programming 
10 associated with said programmed data processor for determining the location of 

said network client by circular intersection and inferring network performance 
associated with accessing said content server to said network client based on a 
performance measurement to said content server in connection with another 
physically proximate network client, ^ 

15 

41 . A system as recited in claim 40, wherein said circular intersection 
comprises: 

(a) measuring the time that it takes for data to move from a plurality of 
network server locations to said client; 

20 (b) converting said times to distance equivalents; 

(c) forming a plurality of intersecting circles using said distance 
equivalents as the radius of circles with said network server locations as the 
center; and 

(d) determining the physical location of said network client from the 
25 intersection of said circles. 

42. A system as recited in claim 33, further comprising programming 
associated with said programmed data processor for Inferring network 
performance of serving said network client from said content server by 

30 determining a weighted average of network performance between said content 

server and other network clients based on physicai proximity of said other network 
clients to said network client and performance of said content server for said other 
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43. A system as recited in claim 33, further comprising programming 
associated with said programmed data processor for 
5 (a) measuring network latency between a content server and a plurality 

of other network clients; 

(b) determining physical distances between said other network clients 
and said network client; 

(c) computing a weighted average of said latency measurements as a 
10 function of said distances, wherein said weighed average comprises an estimate 

of the latency between said content server and said network client; and 

(d) inferring operational characteristics associated with a plurality of 
network clients to said network client using said weighted average. 

15 44. A system for directing a network client requesting access to content 

from a network server to one of a plurality of content servers that can provide said 
content, each said content server having an address, said network server having 
an identity, said method comprising: 

(a) a programmed data processor; and 

20 (b) programming associated with said programmed data processor for 

(i) identifying a network server associated with content 
requested by said network client; 

(ii) identifying a said one of said content servers based on said 
identity of said network server and one or more cost measurements 

25 indicative of operational characteristics of the network; and 

(iii) providing the network client with the address of said content 
server Identified in step (ii). 

45. A system as recited in claim 44, further comprising programming 
30 associated with said programmed data processor for: 

obtaining a new cost measurement when said network client 
accesses said content server; and 
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using said new cost measurement as an indicator of operational 
characteristics of the network in connection with subsequent requests for 
access to said content that can be provided by said content server. 

5 46, A system as recited in claim 44, further comprising programming 

associated with said programmed data processor for measuring networl< 
performance between said network client and a said one of said content servers. 

47. A system as recited in claim 46, wherein an attribute of network 
10 performance comprises network latency. 

48. A system as recited in claim 47, wherein network latency is 
measured passively by determining the time between a syn ack message sent by 
said network client and an ack message sent by said one of said content servers. 

15 

49. A system as recited in claim 46, further comprising programming 
associated with said programmed data processor for measuring network 
performance between said network client and another of said content servers. 



20 5G. A system as recited in claim 44, further comprising programming 

associated with said programmed data processor for determining the location of 
said network client by circular intersection and inferring network peri'ormance 
associated with accessing said content server to said network client based on a 
performance measurement to said content server In connection with another 

25 physically proximate network client. 

51. A system as recited in claim 50, wherein said circular intersection 
comprises: 

(a) measuring the time that it takes for data to move from a plurality of 
30 network server locations to said client; 

(b) converting said times to distance equivalents; 

(c) forming a plurality of intersecting circles using said distance 
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equivalents as the radius of circles with said network server locations as the 
center; and 

(d) detemnining the physical location of said network client from the 
intersection of said circles. 

5 

52. A system as recited in claim 44, further comprising programming 
associated with said programmed data processor for inferring network 
performance of serving said network client from said content server by 
determining a weighted average of network performance between said convent 

10 server and other network clients based on physical proximity of said other network 
clients to said network client and performance of said content server for said other 
network clients. 

53. A system as recited in claim 44, further comprising programming 
15 associated with said programmed data processor for: 

(a) measuring network latency between a content server and a plurality 
of other network clients; 

(b) determining physical distances between said other network clients 
and said network client; 

20 (c) computing a weighted average of said latency measurements as a 

function of said distances, wherein said weighed average comprises an estimate 
of the latency between said content server and said network client; and 

(d) inferring operational characteristics associated with a plurality of 
network clients to said network client using said weighted average. 

25 

54. A system for directing a network client requesting access to content 
from a network server to one of a plurality of content servers providing said 
content for said network server, each said content server having an address, said 
network server having an identity, said system comprising a programmed data 

30 processor and programming associated with said programmed data processor for 
returning the address of a content server that may provide said content the 
identity of the network server one or more cost measurements indicative of 



30 



wo 01/90911 PCT/USOO/23879 

operational characteristics of the network, obtaining a new cost measurement 
when said network client accesses said content server, and using said new cost 
measurement as an indicator of operational characteristics of the network in 
connection with subsequent requests for access to said content that can be 
5 provided by said content server. 

55. A system as recited in claim 54, further comprising programming 
associated with said programmed data processor for measuring network 
performance between said network client and a said one of said content servers. 

10 

56. A system as recited in claim 55, wherein an attribute of network 
performance comprises network latency. 

57. A system as recited in claim 56, wherein network latency is 
measured passively by determining the time between a syn ack message sent by 

15 said network client and an ack message sent by said one of said content servers. 

58. A system as recited in claim 55, further comprising programming 
associated with said programmed data processor for measuring network 
performance between said network client and another of said content servers. 

20 

59. A system as recited in claim 54, further comprising programming 
associated with said programmed data processor for determining the location of 
said network client by circular intersection and inferring network performance 
associated with accessing said content server to safd network client based on a 

25 performance measurement to said content server in connection with another 
physically proximate network client. 

60. A method as recited in claim 59, wherein said circular intersection 
comprises: 

30 (a) measuring the time that it takes for data to move from a plurality of 

network server locations to said client; 

(b) converting said times to distance equivalents; 
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(c) forming a plurality of intersecting circles using said distance 
equivalents as the radius of circles with said network server locations as the 
center; and 

(d) determining the physical location of said network client from the 
5 intersection of said circles. 



61. A system as recited in claim 54, further comprising programming 
associated with said programmed data processor for inferring network 
performance of serving said network client from said content server by 
10 determining a weighted average of network performance between said convent 
server and other network clients based on physical proximity of said other network 
clients to said network client and performance of said content server for said other 
network clients. 

r 

15 62. A system as recited in claim 54, further comprising programming 

associated with said programmed data processor for: 

(a) measuring network latency between a content sen/er and a plurality 
of other network clients; 

(b) determining physical distances between said other network clients 
20 and said network client; 

(c) computing a weighted average of said latency measurements as a 
function of said distances, wherein said weighed average comprises an estimate 
of the latency between said content server and said network client; and 

(d) inferring operational characteristics associated with a plurality of 
25 network clients to said network client using said weighted average. 

63. A system for determining the physical location of a network client 
comprising: 

(a) a programmed data processor; and 
30 (b) programming associated with said programmed data processor for 

(i) measuring the time that it takes for data to move from a 
plurality of network server locations to a network client; 
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(ii) converting said times to distance equivalents; 

(Hi) forming a plurality of intersecting circles using said distance 
equivalents as tiie radius of circles with said network server locations as 
the center; and 

(iv) determining the physical location of said network client from 
the intersection of said circles. 

64. A system for inferring operational characteristics associated with a 
plurality of network clients to an inferable network client, comprising: 

(a) a programmed data processor; and 

(b) programming associated with said programmed data processor for 

(i) measuring network latency between a network server and a 
plurality of network clients; 

(ii) determining physical distances between said network clients 
and an inferable network client; and 

(ill) computing a weighted average of said latency measurements 
as a function of said distances, wherein said weighed average comprises 
an estimate of the latency between said network server and said inferable 
network client. 
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